STATISTICAL MACHINE TRANSLATION IMPROVEMENT BASED ON PHRASE SELECTION
Identifieur interne : 000345 ( Main/Exploration ); précédent : 000344; suivant : 000346STATISTICAL MACHINE TRANSLATION IMPROVEMENT BASED ON PHRASE SELECTION
Auteurs : Cyrine Nasri [Tunisie] ; Latiri Chiraz [Tunisie] ; Kamel Smaili [France]Source :
English descriptors
Abstract
This paper describes the importance of introducing a phrase-based language model in the process of machine translation. In fact, nowadays SMT are based on phrases for translation but their language models are based on classical ngrams. In this paper we introduce a phrase-based language model (PBLM) in the decoding process to try to match the phrases of a translation table with those predicted by a language model. Furthermore, we propose a new way to retrieve phrases and their corresponding translation by using the principle of conditional mutual information. The SMT developed will be compared to the baseline one in terms of BLEU, TER and METEOR. The experimental results show that the introduction of PBLM in the translation decoding improve the results.
Url:
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Hal, to step Corpus: 004322
- to stream Hal, to step Curation: 004322
- to stream Hal, to step Checkpoint: 000321
- to stream Main, to step Merge: 000345
- to stream Main, to step Curation: 000345
Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">STATISTICAL MACHINE TRANSLATION IMPROVEMENT BASED ON PHRASE SELECTION</title><author><name sortKey="Nasri, Cyrine" sort="Nasri, Cyrine" uniqKey="Nasri C" first="Cyrine" last="Nasri">Cyrine Nasri</name><affiliation wicri:level="1"><hal:affiliation type="institution" xml:id="struct-302442" status="VALID"><orgName>Université de Tunis - El Manar</orgName><desc><address><country key="TN"></country></address></desc></hal:affiliation><country>Tunisie</country></affiliation></author><author><name sortKey="Chiraz, Latiri" sort="Chiraz, Latiri" uniqKey="Chiraz L" first="Latiri" last="Chiraz">Latiri Chiraz</name><affiliation wicri:level="1"><hal:affiliation type="institution" xml:id="struct-302442" status="VALID"><orgName>Université de Tunis - El Manar</orgName><desc><address><country key="TN"></country></address></desc></hal:affiliation><country>Tunisie</country></affiliation></author><author><name sortKey="Smaili, Kamel" sort="Smaili, Kamel" uniqKey="Smaili K" first="Kamel" last="Smaili">Kamel Smaili</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-407170" status="VALID"><orgName>Statistical Machine Translation and Speech Modelization and Text </orgName><orgName type="acronym">SMarT</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche/equipes/smart</ref></desc><listRelation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">HAL</idno><idno type="RBID">Hal:hal-01261563</idno><idno type="halId">hal-01261563</idno><idno type="halUri">https://hal.inria.fr/hal-01261563</idno><idno type="url">https://hal.inria.fr/hal-01261563</idno><date when="2015-09-05">2015-09-05</date><idno type="wicri:Area/Hal/Corpus">004322</idno><idno type="wicri:Area/Hal/Curation">004322</idno><idno type="wicri:Area/Hal/Checkpoint">000321</idno><idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">000321</idno><idno type="wicri:Area/Main/Merge">000345</idno><idno type="wicri:Area/Main/Curation">000345</idno><idno type="wicri:Area/Main/Exploration">000345</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en">STATISTICAL MACHINE TRANSLATION IMPROVEMENT BASED ON PHRASE SELECTION</title><author><name sortKey="Nasri, Cyrine" sort="Nasri, Cyrine" uniqKey="Nasri C" first="Cyrine" last="Nasri">Cyrine Nasri</name><affiliation wicri:level="1"><hal:affiliation type="institution" xml:id="struct-302442" status="VALID"><orgName>Université de Tunis - El Manar</orgName><desc><address><country key="TN"></country></address></desc></hal:affiliation><country>Tunisie</country></affiliation></author><author><name sortKey="Chiraz, Latiri" sort="Chiraz, Latiri" uniqKey="Chiraz L" first="Latiri" last="Chiraz">Latiri Chiraz</name><affiliation wicri:level="1"><hal:affiliation type="institution" xml:id="struct-302442" status="VALID"><orgName>Université de Tunis - El Manar</orgName><desc><address><country key="TN"></country></address></desc></hal:affiliation><country>Tunisie</country></affiliation></author><author><name sortKey="Smaili, Kamel" sort="Smaili, Kamel" uniqKey="Smaili K" first="Kamel" last="Smaili">Kamel Smaili</name><affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-407170" status="VALID"><orgName>Statistical Machine Translation and Speech Modelization and Text </orgName><orgName type="acronym">SMarT</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche/equipes/smart</ref></desc><listRelation><relation active="#struct-423086" type="direct"></relation><relation active="#struct-206040" type="indirect"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation><tutelles><tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName><orgName type="acronym">LORIA - NLPKD</orgName><desc><address><country key="FR"></country></address><ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref></desc><listRelation><relation active="#struct-206040" type="direct"></relation><relation active="#struct-300009" type="indirect"></relation><relation active="#struct-413289" type="indirect"></relation><relation name="UMR7503" active="#struct-441569" type="indirect"></relation></listRelation></org></tutelle><tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno><idno type="RNSR">198912571S</idno><idno type="IdUnivLorraine">[UL]RSI--</idno><orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName><orgName type="acronym">LORIA</orgName><date type="start">2012-01-01</date><desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.loria.fr</ref></desc><listRelation><relation active="#struct-300009" type="direct"></relation><relation active="#struct-413289" type="direct"></relation><relation name="UMR7503" active="#struct-441569" type="direct"></relation></listRelation></org></tutelle><tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName><orgName type="acronym">Inria</orgName><desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.inria.fr/en/</ref></desc></org></tutelle><tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno><idno type="IdUnivLorraine">[UL]100--</idno><orgName>Université de Lorraine</orgName><orgName type="acronym">UL</orgName><date type="start">2012-01-01</date><desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine><country key="FR"></country></address><ref type="url">http://www.univ-lorraine.fr/</ref></desc></org></tutelle><tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="ISNI">0000000122597504</idno><idno type="IdRef">02636817X</idno><orgName>Centre National de la Recherche Scientifique</orgName><orgName type="acronym">CNRS</orgName><date type="start">1939-10-19</date><desc><address><country key="FR"></country></address><ref type="url">http://www.cnrs.fr/</ref></desc></org></tutelle></tutelles></hal:affiliation><country>France</country><placeName><settlement type="city">Nancy</settlement><settlement type="city">Metz</settlement><region type="region" nuts="2">Grand Est</region><region type="old region" nuts="2">Lorraine (région)</region></placeName><orgName type="university">Université de Lorraine</orgName></affiliation></author></analytic></biblStruct></sourceDesc></fileDesc><profileDesc><textClass><keywords scheme="mix" xml:lang="en"><term> Conditional Mutual Information</term><term> Phrases selection</term><term>Machine Translation</term></keywords></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">This paper describes the importance of introducing a phrase-based language model in the process of machine translation. In fact, nowadays SMT are based on phrases for translation but their language models are based on classical ngrams. In this paper we introduce a phrase-based language model (PBLM) in the decoding process to try to match the phrases of a translation table with those predicted by a language model. Furthermore, we propose a new way to retrieve phrases and their corresponding translation by using the principle of conditional mutual information. The SMT developed will be compared to the baseline one in terms of BLEU, TER and METEOR. The experimental results show that the introduction of PBLM in the translation decoding improve the results.</div></front></TEI><affiliations><list><country><li>France</li><li>Tunisie</li></country><region><li>Grand Est</li><li>Lorraine (région)</li></region><settlement><li>Metz</li><li>Nancy</li></settlement><orgName><li>Université de Lorraine</li></orgName></list><tree><country name="Tunisie"><noRegion><name sortKey="Nasri, Cyrine" sort="Nasri, Cyrine" uniqKey="Nasri C" first="Cyrine" last="Nasri">Cyrine Nasri</name></noRegion><name sortKey="Chiraz, Latiri" sort="Chiraz, Latiri" uniqKey="Chiraz L" first="Latiri" last="Chiraz">Latiri Chiraz</name></country><country name="France"><region name="Grand Est"><name sortKey="Smaili, Kamel" sort="Smaili, Kamel" uniqKey="Smaili K" first="Kamel" last="Smaili">Kamel Smaili</name></region></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000345 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000345 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Lorraine
|area= InforLorV4
|flux= Main
|étape= Exploration
|type= RBID
|clé= Hal:hal-01261563
|texte= STATISTICAL MACHINE TRANSLATION IMPROVEMENT BASED ON PHRASE SELECTION
}}
| This area was generated with Dilib version V0.6.33. |  |